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1 Abstract 

O 

We present preliminary results of a search for the decay B u — > rfcj). The data were recorded with 
the BABAR detector at the PEP-II asymmetric-energy 5-meson Factory at SLAC and correspond 
to 89 million BB pairs produced in e + e~ annihilation at the T(4S) resonance. We find no evidence 
for a signal and set a 90% CL upper limit of B(B° — ► rj'tp) < 1.0 x 10~ 6 . 
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1 Introduction 



We present the results of a search for the charmless B meson decay B° — > r}'<j). This B decay mode 
to a pseudoscalar and a vector mesons is dominated by penguin contributions. A gluonic penguin 
diagram is shown in Fig. ^ The branching ratio of this decay mode is expected to be very small 
(in the range of 10~ 9 - 10~ 7 ) lj. The study of this decay is pertinent to the factorization model 
for nonleptonic decays and to the penguin mechanism. 




d d 
Figure 1: A gluonic penguin diagram for B° — > r]'<p. 



CLEO, studying this decay with a sample of 3.3 x 10 6 BB pairs, found no evidence for a signal 
and set a 90% CL upper limit of B(B° rf(f>) < 31 x 10" 6 0. 

2 The BaBar Detector and Data 

The results presented in this paper are based on data collected in 1999-2002 with the BABAR 
detector [3] at the PEP-II asymmetric e + e~ collider located at the Stanford Linear Accelerator 
Center. An integrated luminosity of 81.9 fb , corresponding to 89 million BB pairs, was collected 
at the Y(AS) resonance ( "on-resonance" , center-of-mass energy y/s = 10.58 GeV). An additional 
9.6 fb -1 were collected about 0.040 GeV below this energy ("off-resonance") for the study of 
continuum background. The asymmetric beam configuration in the laboratory frame provides a 
boost of /?7 ~ 0.56 to the T(4S*), increasing the momentum range of the i?-meson decay products 
up to 4.4 GeV/c. Charged particles are detected and their momenta measured by a combination 
of a silicon vertex tracker (SVT), consisting of five layers of double-sided detectors, and a 40-layer 
central drift chamber, both operating in the 1.5 T magnetic field of a solenoid. Photons and 
electrons are detected by a CsI(Tl) electromagnetic calorimeter (EMC). 

Charged-particle identification (PID) is provided by the average energy loss (dE/dx) in the 
tracking devices and by an internally reflecting ring-imaging Cherenkov detector (DIRC) covering 
the central region. A Cherenkov-angle ir/K separation of better than 4<r is achieved for tracks 
below 3 GeV/ c, decreasing to 2.4 a at the highest momenta in the final states available in S-meson 
decays. 
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3 Event Selection 



The i?-meson decay B° — > 77'^ is fully reconstructed through the observation of rj' — > /ry or 77' — > 
777r + 7r~, where 77 — > 77 and — > K + K~ . 

Monte Carlo (MC) simulation of the decay mode under study and of the continuum and BB 
backgrounds is used to establish the event-selection criteria. The selection is designed to achieve 
high efficiency and retain sidebands sufficient to characterize the background for subsequent fitting. 
Photons are required to have an energy exceeding a threshold that depends on the mode-dependent 
combinatorial background of the specific mode: an E~ > 0.2 GeV for 77' — ► p°7 candidates and 
Ej > 0.05 GeV for 77' — ► r}Tr + Tr~ , rj — > 77. 

We select 77', 77 , and p° candidates with the following requirements on the invariant masses 
(in GeV/c 2 ) of their final states: 0.920 < m v > < 0.990, 0.490 < m n < 0.600, and 0.500 < m p o < 
0.995. Tracks in rj' (eft) candidates must have DIRC, dE/dx, and EMC responses consistent with 
the pion (kaon) hypothesis. 

A 5-meson candidate is characterized kinematically by the energy-substituted mass ttt-es = 
\J {\ s + Po ' Pb) 2 /Eq — p 2 B and the missing energy AE = E* B — \\fs, where the subscripts and 
B refer to the initial T(4S) and the B candidate, respectively, and the asterisk denotes the T(4S) 
rest frame. We require \AE\ < 0.2 GeV and 5.2 < ttt-es < 5.29 GeV/c 2 . The resolutions on these 
quantities are about 0.030 GeV and 0.003 GeV/c 2 , respectively. 

To reject light-quark continuum background, we make use of the angle 6t between the thrust 
axes of the B candidate and the rest of the tracks and neutral clusters in the event (ROE), calculated 
in the center-of-mass frame. The distribution of | cos 9t\ is sharply peaked near 1 for combinations 
drawn from the jet-like qq events, and nearly uniform for the B meson decays. We apply the cut 
I cos#t| < 0.9. A second B candidate satisfying the selection criteria occurs in about 7% (18%) of 
the events in the decay mode 77' — ► /9°7 (77' — ► rjTr + ir~). In this case we pick the combination with 
the 77' mass closer to the PDG value 0. 

To discriminate against tau-pair and two-photon backgrounds we require the event to contain 
at least five charged tracks. 

The remaining continuum background dominates the samples and is modeled from sideband 
data in the maximum-likelihood (ML) fit described in sectional 

We use MC simulation of B°B° and B + B~ pair production and decay to look for possible BB 
backgrounds. Other charmless B decays turn out to be the most likely other source of backgrounds 
in this study. To evaluate this source, we have produced a high statistics enriched sample of such B 
decays, using available estimates of the branching ratios. From these studies we find no evidence 
of a significant BB background. 

4 Maximum Likelihood Fit 

We use an unbinned, multivariate maximum likelihood fit to extract the signal yield. With the 
cuts described in Section |21 -B-meson candidates are selected to match the kinematic structure of 
the decay mode B° — > rj<$>. 

4.1 The Likelihood Function 

The likelihood function incorporates several weakly correlated variables. For the kinematics of the B 
decay we use AE and tties- We also include the mass of the 77' and , for the B production and energy 
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flow a Fisher discriminant T . We combine the following four variables into a Fisher discriminant: 
the angles with respect to the beam axis in the center-of-mass frame of the B momentum and the 
B thrust axis, and the zeroth and second Legendre moments of the tracks and neutrals not used 
in reconstructing the decay r/0 computed with respect to the I?-candidate thrust axis. 

Thus, the input variables for the TjL^^ channel are AE, toes> tti', 3~ , an d the angular variable 
TCfp. In the analysis of the rj' pi channel we add the angular variable TC p . The angular variable Ti^ is 
the cosine of the angle between the direction of the daughter K + with respect to the direction of the 
parent B in the <f> rest frame. The angular variable 7i p is defined as the cosine of the angle between 
the direction of a p 0, s daughter and the direction of the parent 77' in p° rest frame. These variables 
have a sin 2 6 and cos 2 9 shape in signal events, respectively. In the continuum qq background the 
distributions of both angular variables are flat. 

Since we measure the correlations among the observables in data to be small, we take the PDF 
for each event to be a product of the PDFs for the separate observables. We define two hypotheses 
j, where j can be either signal or continuum background. The product PDF (to be evaluated with 
the observable set for event i) is then given (for 77' „.) by: 

V) = V,(m ES ) ■ Pj(AE) ■ Vj{J=) ■ Pj(m v >) ■ V 3 {U^. (1) 
The extended likelihood function for all input events iV is: 

* j 

where Nj is the number of events of species j to be found by the fitter. 
4.2 Preparation of Inputs 

The PDF determination for the likelihood fit is accomplished with use of Monte Carlo for the signal 
and on-resonance sideband data for the continuum background. 

Peaking distributions (signal masses, AE and J-) are parameterized as Gaussian functions. To 
obtain good fits to these samples we employ a sum of two or three Gaussian functions or Gaussian 
functions with different widths above and below the central value. Slowly varying distributions 
(combinatoric background under mass or energy peaks) have linear behavior. The combinatoric 
background in tties is described by an empirical phase-space function H<f> and 7i p PDFs for 
signal are described by second-order polynomial (without the linear term) while those for the 
background are described by a linear and a second-order polynomial, respectively. 

Control samples of B decays to charm final states of similar topology are used to account for 
the fidelity of the MC for variables describing S-decay kinematics. We adjust the MC resolutions 
and central values, when necessary, by comparing data and simulation in these control samples. 

5 Systematics 

The uncertainty in the values of the parameters used in the PDFs are a source of systematic 
error. Variation of these parameters by 1 a induces an uncertainty of 0.03 signal events. The 
fitting procedure itself is a source of systematic uncertainty. Studies with simulated samples and 
background populations find that this uncertainty amounts to 0.21 signal events. 



10 



The remaining systematic uncertainties are multiplicative. Those due to MC statistics, track 
and photon multiplicities and B production are estimated from auxiliary studies. Published world 
averages |H] provide the 5-daughter branching fraction uncertainties. The systematic error due to 
all these sources is estimated to equal 0.06 events. 

The overall systematic error is 0.2 events (or 0.1 x 10 -6 in terms of the branching fraction). 
This error is incorporated into the upper-limit calculation as described in the following section. 

6 Fit Results 

We find no signal events in the on-resonance sample and for this reason we adopt the Bayesian 
method to calculate the 90% CL upper limit. We perform ML fits in the physical region of the 
parameters and integrate the likelihood from zero to the branching fraction value where the integral 
reaches 90% of its asymptotic value. 

The 7?p 7 <^ and modes are reconstructed with an overall efficiency of 3.3% and 2.1%, 

respectively. The measured value for the 90% CL upper limit is 1.6 x 10~ 6 for rj'p^ffi an d 2.0 x 10~ 6 for 
rj'^^cj). We combine these upper limit measurements by forming for each decay mode a convolution 
of C from the fit with a Gaussian representing the uncorrelated systematic error. The curves of 
— 21n£ are shown in Fig. |^1 for both decay modes and for the sum of the two. 

E 

^ 30 
25 
20 
15 
10 

5 



0.5 1 1.5 2 2.5 3 3.5 .4 

BR(x 10 ) 

Figure 2: Distributions of — 21n£ vs. branching fraction for r]'(f) decays. Dotted, dashed and solid 
lines correspond to 7/ — > p°7, rf —* 7/7r + 7r~ and to the combined decay modes, respectively. 



7 Conclusion 

We have performed a search for the charmless B° meson decay to rfcj). We find no signal and we 
set a 90% CL upper limit: 

B(B° -» rf<f>) < 1.0 x 10~ 6 . 
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